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ABSTRACT 

An  Adaline  (adaptive  linear  neuron)  can  be  trained  to  distinguish 
between  sets  of  inputs.  In  general,  the  quantized  output  is  used.  This 
report  investigates  the  usefulness  of  the  analog  output  of  Adaline  for 
measuring  the  frequency  of  occurrence  of  a  number  of  different  events. 
Each  event  is  more  or  less  arbitrarily  associated  with  a  pattern  and  it 
is  shown  that  the  degree  to  which  Adaline  has  been  trained  to  recognize 
any  one  of  these  patterns  can  be  used  as  a  measure  of  the  frequency  of 
occurrence  of  the  associated  event.  The  application  of  this  use  of 
Adaline  to  a  random-access  file  is  simulated  in  order  to  show  its  use 
in  reducing  average  access  time. 
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mmq(n) 
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N  total  number  of  different  events 
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I .  INTRODUCTION 


The  problem  to  which  this  report  is  devoted  is  believed  to  occur 

frequently  in  different  forms  and  will  first  be  described  in  general 

terms  and  then  as  applied  to  a  specific  example,  a  random-access  memory 

file.  The  schematic  diagram  of  Fig.  1  shows  this  general  case.  A 

finite  number  of  identical  events  take  place  repeatedly  in  a  given  total 

number  of  events.  The  number  of  possible  different  events  is  N  .  The 

o 

probabilities  of  events  1  through  Nq  occurring  are  designated  by 

Probj  through  ProbN  respectively.  The  total  number  of  events  is 

o 

assumed  to  be  100.  These  probabilities  are  not  known  initially,  however, 
and  are  to  be  determined  such  that  the  resulting  probabilities  Pr^ 
through  Pr^  represent  a  recent  measurement.  In  other  words,  it  is 
desired  to  forget  the  distant  past  in  favor  of  more  emphasis  on  the 
recent  past.  It  is  believed  that  Adaline  (adaptive  linear  neuron) 

[Ref.  1  ]  can  solve  this  task  in  the  most  natural  manner.  Before  going 
into  "how, "  it  is  useful  to  consider  the  random-access  memory  application. 

As  a  result  of  the  relative  slowness  of  mechanical  mechanisms  that 
perform  one  or  more  of  the  accessing  motions,  the  access  or  seek  time  in 
a  random-access  file  depends  greatly  on  the  location  in  the  file  of  the 
record  to  which  an  access  is  to  be  made.  The  simplest  case  is  that  in 
which  the  mechanism  returns  to  a  home  position  after  each  access,  such 
that  the  records  nearest  the  home  position  have  the  shortest  seek  time, 
and  those  farthest  away,  the  longest.  It  is  quite  unusual  for  all  records 
to  have  more  or  less  equal  activities,  i.e.,  equal  number  of  accesses  in 
a  given  period  of  time.  In  fact,  the  usual  situation  is  that  in  which  a 
large  fraction  of  the  total  number  of  accesses  is  made  to  a  small  fraction 
of  the  total  number  of  records.  For  instance,  80  percent  of  accesses  may 
be  made  to  20  percent  of  the  records.  In  such  a  situation  it  would 
obviously  be  advantageous  to  place  these  most  active  records  near  the 
home  position  for  the  shortest  possible  average  seek  time.  In  order  to 
permit  occasional  rearranging  of  the  records  in  the  file  to  obtain  this 
advantage,  it  is  necessary  to  determine  the  probabilities  of  seeks  to 
all  the  records  of  the  file.  Figure  2  shows  this  file-access  model  in 


EVENT  NO:  1  2  3  4  5 


TAXES  PLACE  WITH  THESE  PROBABILITIES:  Prob,  Prob.  Prob,  ...  Prob 

14  3  N 

( 

PROBLEM:  HOW  TO  OBTAIN  THE  RELATIVE  MAGNITUDES  OF  THESE  Prob'S  WITH 
AD ALINE 


PROCEDURE: 


ONE  PATTERN  P,  P.  P,  P.  P.  ... 

14  3  4  5 

IS  ASSIGNED  TO  EACH  EVENT 

EACH  TIME  EVENT  1  TAXES 
PLACE,  AD ALINE  IS  ADAPTED 
TO  PATTERN  P1 

ON  INTERROGATION,  CONFIDENCE 
LEVELS  Cx  C2  C3  ...  ARE 
OBTAINED 


AD ALINE  OUTPUT  = 


Pr, 


CONTENTION: 


THE  Prt  ARE  A  MEASURE  OF  THE  Pro^ ,  AT  LEAST  TO  THE 
EXTENT  THAT  IF 

Prob#  >  Prob^j  >  Prob^  >  .  . . 

THIN 


Pr.  >  Pr. 


>  Pr  > 
7 


FIG.  1.  GENERAL  PROBLEM. 
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RECORD  NO.:  1234567  ...  N 


PROBABILITY  OF  ACESS  TO  ABOVE  RECORDS:  Prob.  Prob„  ...  Prob„ 

1  «  N 


PROCEDURE: 

ASSIGN  PATTERNS  (P  p2  p3  p4  ... 

TRAIN  AD ALINE  WITH  THE  pt  IN 
NUMBERS  PROPORTIONAL  TO  THE 
Prob. 


INTERROGATE  AD ALINE  WITH: 


Prob. 

HVn 

1  234  5  4  7  ...  1  ' 

RECORD  NO. 

PATTERNS — 
CONFIDENCE  LEVELS— 


P!  P2  P3  P4  P5 
C1  C2  C3  C4  C5 


i-qm  -  *» 


‘2  3  “4  “5 


SORT  THE  Pr  IN  DESCENDING  ORDER  OF  MAGNITUDE:  Prg  >  Pr2  >  >  P^ 

•  • •  Pr j  •  •  • 

SEEK  TIMES  FOR  POSITIONS  1  TO  No:  ^  s2  s3  «4  ...  Sj  ... 

FORM  PRODUCTS:  Sx  x  Probg ,  S2  x  Prob^ ,  Sg  x  Prob4  ...  Si  x  Prob^  ... 


i=N_ 


AVERAGE  SEEK  TIME  -  5  ^  (Si  '  Probj) 


1=1 


FIG.  2.  MODEL  OF  FILE. 
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schematic  form.  The  first  line  of  Fig.  2  simply  shows  the  record  numbers, 

later  to  be  limited  to  10.  Next,  Prob  is  the  actual  probability  of  an 
th  1 

access  to  the  i  record.  In  order  to  bring  Adaline  into  the  picture, 
a  pattern  is  assigned  to  or  generated  from  each  record  and  this  pattern 
is  compatible  in  form  and  dimension  with  the  number  of  inputs  to  Adaline. 
(A  brief  review  of  the  operation  and  function  of  Adaline  is  contained  in 
the  next  chapter.) 

In  the  experiments  that  follow,  the  number  of  inputs  to  Adaline  are 
taken  as  32  and  the  signal  levels  as  +1  or  -1.  Whenever  an  access  is 
made  to  one  of  the  records  in  the  file,  the  corresponding  assigned  pat¬ 
tern  is  presented  to  Adaline  and  an  adaption  is  performed.  Thus  Adaline 
is  trained  to  recognize  these  patterns  more  or  less  reliably  depending 
on  how  many  accesses  to  this  record  (pattern)  have  been  made  recently. 

The  term  "recently”  is  used  because  Adaline  has  the  ability  to  forget 
gradually  those  patterns  that  are  inactive  or  of  low  activity.  Whenever 
an  opportunity  arises,  because  of  a  break  in  the  activity  of  the  file  as 
a  whole,  the  record  probabilities  are  determined  by  interrogating  Adaline 
with  all  the  patterns  that  have  been  assigned  to  records.  Only  the  analog 
output  is  required  and  the  probability  of  access  is  presumed  to  be  meas¬ 
ured  by  the  reciprocal  of  1  -  I  confidence  level!.  Since  the  confidence 
level  is  close  to  1  after  many  adaptions,  this  measure  seems  reasonable. 
The  records  are  then  sorted  into  a  sequence  having  descending  probabili¬ 
ties  of  access.  The  record  with  the  highest  probability  is  thus  located 
nearest  the  home  position;  and  the  lowest,  farthest  away.  This  process 
is  repeated  periodically  to  keep  the  file  up  to  date  with  respect  to 
changes  in  the  probability  function.  Provided  enough  time  is  available 
to  rearrange  the  records  more  or  less  continually,  the  file  may  be  main¬ 
tained  at  or  near  optimum  average  seek  time.  (This  rearrangement  may  be 
performed  by  having  one  or  more  spare  tracks  on  which  the  records  would 
be  rewritten  before  placing  them  in  their  new  locations.) 

It  is  evident  that  the  more  nearly  the  order  of  the  probabilities 
Pr^  corresponds  to  the  order  of  the  actual  probabilities  Prob^,  the 
more  effectively  will  the  average  seek  time  approach  the  best -obtainable 
average  seek  time.  How  well  this  goal  can  be  reached  is  investigated 
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here  in  a  number  of  experiments  with  simulated  Adalines  and  simulated 
file  operations. 
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II.  AD ALINE  OPERATION 


This  chapter  presents  a  brief  review  of  the  elements  making  up  an 
Adaline  and  their  operation  insofar  as  they  are  relevant  to  the  specific 
application  of  the  Adaline  considered  here  [Refs.  1,  2].  For  this  pur¬ 
pose  Adaline  may  be  represented  by  Fig.  3.  There  are  N  inputs  to  Adaline. 
These  may  assume  the  values  +1  or  -1  only.  Each  input  is  amplified  with 
a  gain  of  A^  which  is  continuously  adjustable  under  the  control  of  the 
adaption  processor,  or  adapter.  The  sum  of  all  the  amplified  inputs  is 
formed,  which  is  the  "confidence  level"  for  the  particular  input  pattern. 
The  confidence  level,  as  well  as  the  inputs  themselves,  are  fed  into  the 
adapter.  From  this  information  the  adapter  determines  what  changes  to 
make  to  the  gains.  This  decision  making  forms  the  adaption  procedure. 

The  principal  adaption  procedure  used  here  is  the  following:  a 
"desired  output"  is  formed  which  has  the  magnitude  1  and  the  same  sign 
as  the  confidence  level  formed  before  the  adaption.  This  procedure  is 
considered  a  "bootstrap  adaption"  since  no  a  priori  desired  output  exists. 
The  error  is  the  difference  between  the  just-formed  desired  output  and 
the  confidence  level.  It  may  be  positive  or  negative.  Adaption  then 
consists  of  changing  all  the  gains  by  an  amount  proportional  to  the  product 
of  the  error  and  the  input  to  that  gain.  The  constant  of  proportionality 
is  1/32C,  in  which  C  is  a  time-constant  factor.  Thus,  the  larger  the 
C  the  more  adaptions  will  be  required  to  reach  a  confidence  level  close 
to  1  in  magnitude.  With  C  =  1  the  confidence  level  of  1  would  be 
obtained  after  only  one  adaption.  Here,  values  for  C  of  6,  10,  and  12 
have  been  used. 

As  already  mentioned,  the  fraction  l/(l  *  (confidence  level])  is 
considered  to  be  a  measure  of  the  probability  of  an  access  to  the  record 
to  which  the  pattern  corresponds.  This  fraction  can  be  obtained  in  an 
interrogation  which  is  simply  the  first  part  of  the  adaption,  viz.,  the 
summing  of  the  amplified  inputs  yielding  the  confidence  level. 

A  different  adaption  procedure  is  used  only  briefly  and  consists  of 
adding  a  fixed  increment  to  each  gain  equal  to  the  product  of  the  input 
and  the  sign  of  the  confidence  level.  This  increment  may  be  multiplied 
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by  a  reduction  factor  to  keep  the  size  of  the  confidence  level  within 
reason,  but  its  size  has  no  other  effect.  The  confidence  level  is  now 
used  as  a  measure  of  probability  of  access  to  that  record.  To  avoid 
misunderstanding,  it  should  be  mentioned  that  only  the  experiment  result¬ 
ing  in  Fig.  12  (Chapter  V)  uses  this  latter  adaption  procedure  and 
probability  measure. 


inwti  -  +  1 


FIG.  3.  SCHEMATIC  OF  AD ALINE  BASED  ON  REFS.  1  AND  2. 
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III.  METHOD  AND  PREVIEW  OF  EXPERIMENTS 


All  experiments  were  performed  by  simulation  on  the  IBM  7090  com¬ 
puter,  assuming  linear  amplifiers  for  all  Inputs.  Actually,  one  simulation 
was  made  assuming  that  the  amplifiers  would  saturate  like  an  arctangent 
function.  The  result  was  not  essentially  different  from  the  same  simu¬ 
lation  assuming  linear  amplifiers.  The  program  is  very  time-consuming 
and  was  not  considered  worth  pursuing. 

To  begin  with,  a  certain  probability-of -access  function  was  assumed. 
The  probabilities  were  assumed  to  only  two  significant  figures  so  that 
they  could  be  reproduced  exactly  in  100  accesses.  For  the  complete  file 
simulation  the  probability  functions  were  restricted  further  as  described 
under  that  experiment  (Chapter  VI ).  But  generally,  they  were  simple 
functions  often  containing  pairs  of  records  with  equal  probabilities  to 
show  whether  these  were  sensed  as  equal  by  Adaline.  After  the  number  of 
accesses  (out  of  100)  to  each  record  is  determined,  the  sequence  is 
shuffled  as  follows: 

1.  Batch  the  accesses  in  ascending  order  by  size,  smallest  batch  first, 
to  form  the  first  sequence.  (All  accesses  to  the  same  record  form 

a  "batch.") 

2.  Use  the  top  record  from  the  first  sequence  (for  convenience, 
designated  as  A)  to  form  the  beginning  of  a  second  sequence. 

3.  Pick  the  next  record  (b)  from  the  first  sequence  and  place  it  on 
top  of  the  second  sequence,  then  Bwitch  the  bottom  record  so  that 
it  becomes  the  top  record. 

4.  Transfer  the  next  record  (c)  from  the  first  sequence  to  the  top  of 
the  second  sequence,  and  again  switch  the  bottom  record  to  the  top. 

5.  Continue  alternating  records  from  the  first  sequence  with  the  bottom 
record  of  the  second  sequence  until  there  are  no  records  left.  In 
effect,  the  new  sequence  now  becomes  the  old. 

6.  Repeat  steps  1  through  5  three  times. 

This  process  results  in  a  fairly  random  looking  sequence,  yet  it  can 
be  programmed  and  repeated  for  any  probability  function.  Every  experiment, 
unless  otherwise  stated,  was  begun  with  all  gains  reset  to  0.  This 
resetting  at  least  insured  repeatability  of  any  experiment,  although  it 
does  not  represent  a  realistic  situation.  The  effect  of  the  resetting  of 
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the  gains  is,  however,  believed  to  be  slight  after  a  number  of  adaptions. 
This  fact  is  particularly  true  since  at  least  200,  and  often  several 
thousand,  adaptions  were  performed  on  every  experiment. 

Most  experiments  were  made  with  random  and  mutually  orthogonal  sets 
of  input  patterns.  (Patterns  are  orthogonal  if  their  scalar  products 
vanish.)  With  random  patterns  the  indicated  probabilities  (or  output) 
are  dependent  on  the  selection  of  the  pattern  set  and  on  how  the  patterns 
are  assigned  to  the  various  records.  To  demonstrate  this  effect  on  the 
one  hand  and  to  avoid  it  (by  averaging)  on  the  other,  pattern  assignments 
were  rotated.  Rotation  of  pattern  assignment  is  simply  advancing  every 
pattern  so  that  it  is  now  assigned  to  the  succeeding  record.  The  last 
pattern  thus  becomes  assigned  to  the  first  record.  After  N0  rotations, 
where  Nq  is  the  number  of  different  records  and  patterns,  the  original 
assignments  are  restored.  In  most  of  the  experiments,  complete  assignment 
rotation  was  performed. 

In  order  to  describe  Adaline's  accuracy  in  detecting  probabilities 
in  these  experiments,  the  given  (i.e.,  the  actual)  probabilities  may  be 
compared  with  the  output  of  Adaline.  This  comparison  can  be  in  the  form 
of  an  actual  plot  of  the  probability  function  after  every  5,  10,  or  25 
adaptions  and  comparing  these  graphs  with  the  graph  of  the  given  function. 
These  graphs  are  shown  on  the  left  side  of  Fig.  4.  It  is,  however,  very 
tedious  to  plot  these  functions  and  it  is  often  difficult  to  compare  them 
when  there  are  many  or  if  they  cannot  be  shown  adjacent  to  one  another. 

The  correlation  coefficient  between  the  given  and  the  output  probability 
functions  is  as  good  as  any  single  figure  of  merit.  It  is  shown  along¬ 
side  the  probability  functions  in  Fig.  4.  (These  graphs  were  taken  from 
the  first  30  adaptions  on  10  random  patterns.)  To  get  a  better  feel  for 
the  significance  of  the  correlation  coefficient,  a  number  of  fictitious 
output  functions  are  plotted  in  Fig.  5  with  a  given-probability-function 
graph.  The  correlation  coefficients  range  from  +0.994  to  -1.000  in  this 
case.  Most  of  the  more  complicated  experiments  are  described  by  the 
associated  correlation  coefficients  only. 
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FIG.  4.  CORRELATION  COEFFIC 
(lO  random  patterns.) 
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GIVEN  PROBABILITY 

FICTITIOUS  OUTPUT  SETS  FUNCTION 
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FIG.  5. 


CORRELATION 


COEFFICIENTS  AND  FICTITIOUS  AD ALINE  OUTPUTS. 
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Basically,  three  types  of  experiments  were  performed:  static  and 
dynamic  adaptions  and  file  simulation.  An  attempt  is  made  to  describe 
the  behavior  of  the  Adaline  output  with  regard  to  the  following: 

1.  Differences  between  orthogonal  and  random  patterns. 

2.  Effect  of  the  time-constant  factor. 

3.  Effect  of  the  number  of  patterns  for  a  given  number  of  Adaline 
inputs. 

4.  Effect  of  the  size  of  the  discrepancy  between  adjacent  record 
probabilities  on  the  accuracy  of  the  output. 

In  the  dynamic  experiments  the  following  additional  information  was 
sought: 

5.  Effect  of  change  in  probability  function  on  recovery. 

6.  Behavior  under  repeated  changes  of  probability  function. 

File  simulation  consisted  of  just  one  experiment  that  included  many 
of  the  above  aspects,  plus  an  overall  effectiveness  measure  as  far  as 
seek-time  improvement  is  concerned. 
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IV.  STATIC  BEHAVIOR 


Figures  6  and  7  show  the  input  probability  functions  and  output 
functions  with  orthogonal  and  random  patterns  respectively.  Since  the 
given  probability  function  is  truly  represented  only  after  100  records 
or  patterns  have  been  adapted,  one  would  not  expect  the  input  function 
to  be  reproduced  by  the  output  with  any  fidelity  until  after  100  adap¬ 
tions.  As  is  evident  from  the  graphs,  the  output  after  100  adaptions 
in  the  case  of  the  orthogonal  patterns  is  a  faithful  reproduction  of 
the  given  function.  In  the  random  case  there  is  evidence  of  gross  error 
in  pattern  4.  This  effect  is  due  to  the  confidence  level  for  that  pat¬ 
tern  being  influenced  by  one  other  pattern  or  a  combination  of  several 
other  patterns.  This  type  of  "cross  adaption"  will  be  discussed  in  more 
detail  in  Chapter  VII.  It  will  be  shown  that  the  correction  vector, 
which  is  added  to  the  gain  vector  in  an  adaption,  is  parallel  to  the 
pattern  vector  on  which  the  model  is  adapting.  The  confidence  level  is 
the  scalar  product  of  the  gain  vector  and  the  pattern  vector.  Thus  it 
is  evident  that  adaption  on  one  pattern  will  not  affect  the  confidence 
level  of  another  pattern  that  is  orthogonal  to  the  first  one.  One 
therefore  would  expect  the  "exact"  reproduction  of  the  input  probabili¬ 
ties  as  shown  in  the  bottom  graph  of  Fig.  6. 

Figure  8  summarizes  the  results  of  seven  experiments  investigating 
effects  of  gross  differences  in  the  probabilities  of  the  input  prob¬ 
ability  function.  To  start  with,  record  10  has  a  probability  of  0.79, 
and  record  9  has  probability  0.06,  and  each  successively  lower  record 
number  has  a  probability  0.01  less  than  the  preceding  one.  The  10  pat¬ 
terns  are  random  patterns  and  pattern  assignments  were  rotated  completely 
so  that  each  pattern  was  assigned  to  each  record  once.  Output  prob¬ 
abilities  were  determined  by  interrogation  of  Adeline  after  100  and  200 
adaptions.  This  procedure  then  resulted  in  20  sets  of  output  probabili¬ 
ties.  These  sets  were  averaged,  with  the  results  as  shown  in  Fig.  8. 

In  the  succeeding  experiments  the  probability  of  record  10  was 
reduced  in  steps  of  0.09,  and  the  remaining  probabilities  all  increased 
by  0.01.  The  patterns  remained  the  same  throughout.  The  fidelity  of 
the  output  remained  excellent  to  the  last  experiment  in  which  the  two 
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largest  input  probabilities  were  0.25  and  0.12.  This  fidelity  is  an 
indication  of  successful  operation  where  relatively  large  discrepancies 
in  input  probabilities  exist,  which  after  all  are  the  situations  of 
greatest  interest  because  only  in  these  cases  can  some  improvement  in 
access  time  be  expected. 

Summarizing,  static  behavior  demonstrates  Adaline's  ability  to 
reproduce  exactly  the  input  probabilities  in  the  case  of  orthogonal  pat¬ 
terns  and  nearly  so,  on  the  average,  for  random  patterns. 
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FIG.  6.  AD ALINE  ADAPTION  WITH 
ORTHOGONAL  PATTERNS. 


FIG.  7.  AD ALINE  ADAPTION  WITH 
RANDOM  PATTERNS. 


tXMHIMINT  2 


FIG.  8.  A  DAL  INK  ADAPTIONS  ON  FUNCTIONS  WITH  GROSS  DIFFERENCES  BETWEEN  PROBABILITIES. 
(A  =  given  probability  function;  B  *  average  Adallne  output.) 
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FIG.  8.  (Continued) 


V.  DYNAMIC  BEHAVIOR 


The  first  dynamic  experiment  was  an  adaption  to  a  flat  probability 
function  after  Adaline  had  already  been  adapted  1000  times  to  the  prob¬ 
ability  function  shown  in  the  first  diagram  of  Fig.  9.  The  output 
probability  function  is  shown  directly  below.  The  output  functions 
resulting  after  the  change  are  reproduced  for  every  100  adaptions.  This 
experiment  was  done  with  orthogonal  patterns  and  must  be  considered  one 
of  the  more  difficult  adaptions  because  of  the  absolutely  flat  input. 
Adaption  was  slow,  but  after  1100  adaptions  the  output  approached  a  flat 
function.  The  logarithmic  scale  for  the  12  output  diagrams  is  the  same 
but  was  not  converted  to  "probability"  dimension,  i.e.,  the  sum  of  the 
ordinates  is  not  1. 

The  remaining  dynamic  experiments  are  described  by  changes  in  cor¬ 
relation  coefficient  between  the  input  function  and  the  output.  It 
would  then  be  expected  that  a  meaningful  measure  could  be  obtained  only 
every  100  adaptions,  because  only  then  are  the  input  probabilities 
coincident  with  the  actual  pattern  frequencies.  In  the  case  of  simple 
input  functions,  actual  frequency  distributions  resembling  the  input 
functions  are  reached  after  only  a  dozen  or  so  adaptions  because  of  the 
effective  scrambling  of  record  sequences.  It  was  therefore  considered 
worthwhile  in  some  experiments  to  show  the  correlation  coefficient  for 
every  ten  adaptions.  The  six  plots  of  Fig.  10  each  relate  to  behavior 
after  a  single  change  in  input  probability  function  to  the  inverse 
functions. 

In  Figs.  10a  and  10b,  ten  random  patterns  were  used  and  the  dif¬ 
ference  between  the  two  figures  is  only  the  time-constant  factor,  which 
is  12  for  Fig.  10a  and  6  for  Fig.  10b.  Adaption  to  the  new  input  is  not 
too  good  in  either  case,  probably  because  of  an  unfortunate  choice  of 
the  pattern  set.  For  random  patterns  good  reproduction  of  the  input  can 
be  expected  only  in  a  statistical  sense  and  not  necessarily  for  every 
pattern  set  in  a  single  experiment.  Similar  comments  are  in  order  for 
a  comparison  of  Figs.  10b  and  10c,  which  differ  only  in  the  number  of 
patterns  employed.  It  is  Impossible,  however,  to  produce  exactly  the 
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same  input  probability  function  for  24  patterns  as  for  10.  The  24  pat¬ 
terns  selected  include  the  10  used  in  the  preceding  experiment.  It  is 
evident  that  adaption  to  both  the  original  input  function  as  well  as  to 
the  inverse  function  is  slower  for  the  larger  number  of  patterns,  as 
would  be  expected. 

The  next  three  experiments  are  a  repetition  of  the  preceding  three 

except  that  they  were  performed  with  orthogonal  patterns.  Figures  lOd 

and  lOe  show  the  effect  of  change  in  time-constant  factor.  The  effect 

is  small  and  it  would  appear  that  a  time-constant  factor  of  12  gives  a 

somewhat  better  correlation  coefficient.  Since  in  an  actual  application 

the  time-constant  factor  would  have  to  be  chosen  for  the  particular 

dynamic  conditions  prevailing,  in  this  case  12  would  be  the  preferred 

choice.  It  is  interesting  that  in  both  experiments  the  correlation 

coefficient  shows  a  very  sudden  change  from  a  large  negative  value  to  a 

large  positive  value  exactly  100  adaptions  after  the  change  in  input 

functions.  This  sudden  change  indicates  that  adaption  to  the  existing 

frequency  distribution  is  fairly  complete  at  some  time  prior  to  the 
th 

100  adaption  after  the  change,  and  when  the  existing  frequency  dis¬ 
tribution  suddenly  coincides  with  the  given  input-function,  correlation 
becomes  very  good  suddenly.  This  argument  also  explains  the  fairly 
rapid  change  but  not  the  step  at  the  200th  adaption.  Examination  of  the 
output  at  that  point  reveals  that  it  is  a  completely  flat  function, 
unfortunately  producing  a  large  correlation  coefficient  with  the  input 
function,  which  is  approximately  a  straight  line.  This  finding  points 
up  one  of  the  shortcomings  of  the  correlation-coefficient  presentation. 

Figures  lOe  and  lOf  again  show  the  effect  of  an  increase  in  the 
number  of  patterns,  which  results  in  definitely  slower  adaptions.  The 
step  has  disappeared  because  of  the  incomplete  adaption  near  the  200th 
adaption.  Again  comparisons  of  these  two  experiments  should  not  be 
carried  too  far  because  of  the  differences  introduced  by  the  change  in 
the  input  function  and  the  addition  of  new  patterns  to  make  up  24.  This 
latter  effect  would  not  be  as  drastic  as  in  the  case  of  random  patterns, 
however,  because  orthogonality  cross  effects  are  not  present  in  adaption. 
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PROBABILITY  FUNCTION  IS  CHANOEO  FROM  NO.  1l  0.00  0.00  0.0S  0.05  0.10  0.10  0.IS  0.15  0.20  0.20 

TO  NO.  2i  0.10  0.10  0.10  0.10  0.10  0.10  0.10  0.10  0.10  0.10 


FIG.  9.  DYNAMIC  BEHAVIOR  WITH  A  SINGLE  CHANGE  IN  PROBABILITY  FUNCTION. 
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LOG  SCALE 


PROBABILITY  PUMCTIOHt  0.00  OlOO  0.05  0.01  0.M  0.10  0.15  BIS  0.10  0.M 

15  CHANOID  TO  “INVIR5I".  0.20  BN  0.15  0.10  0.10  0.10  0.05  BOS  BOO  0.00 


CNANSI  TO  INVBRM  HIM 


FIG.  10.  DYNAMIC  BEHAVIOR  FOR  A  CHANGE  TO  INVERSE  PROBABILITY  FUNCTION. 
(Parts  a  through  t  are  on  pages  22-24.) 
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CHANS!  TO  IN V!  HI  FUNCTION  NIDI 


c.  24  random  patterns,  C  =  6 
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CHAHOI  TO  IHVIMi  FUNCTION  HIM 


e.  10  orthogonal  patterns,  C  =  6 


CHANOI  TO  IMVMM  FUNCTION  HIM 


f.  24  orthogonal  patterns,  C  =  6 
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The  following  experiments  were  conducted  over  a  much  larger  number 

of  adaptions  and  the  correlation  coefficient  was  evaluated  every  100 

adaptions  only.  The  patterns  were  orthogonal.  Figure  11  shows  behavior 

for  approximately  1000  adaptions  before  and  after  a  change  in  input 

function.  First,  changes  from  the  same  original  input  function  to  four 

different  functions  are  shown  and  then  four  consecutive  changes  after 

approximately  1000  adaptions  are  shown.  One  of  the  slowest  adaptions 

after  the  change  is  the  change  to  the  inverse  function  that  was  shown  in 

the  preceding  experiments.  Here,  however,  the  adaption  was  even  slower 

because  it  was  preceded  by  1000  adaptions  on  the  original  input  function. 

As  would  be  expected,  speed  of  adaption  is  largely  influenced  by  the 

severity  of  the  change  in  input  function.  The  fastest  recovery  occurred 
th 

after  the  3100  adaption,  which  involved  a  fairly  mild  change  in  input 
function. 

Figure  12  shows  experiments  made  with  the  alternate  adaption  pro¬ 
cedure,  in  which  a  fixed  correction  was  made  to  the  confidence  level  by 
adding  to  the  gain  vector  a  vector  that  was  proportional  to  the  input - 
pattern  vector.  First,  a  change  to  the  inverse  function  was  made;  there 
was  only  a  small  indication  of  a  recovery  of  the  correlation  coefficient 
after  1000  adaptions.  Next,  a  change  to  an  almost  flat  function  showed 
no  trend  of  recovery.  The  third  change  was  back  to  the  original  input 
function,  which  showed  good  recovery  because  Adaline  was  essentially 
still  adapted  to  that  original  input. 

With  this  adaption  procedure,  the  confidence  level  becomes  so  large 
that  it  is  difficult  to  change  it  rapidly  thereafter.  As  is  evident 
from  the  first  1000  adaptions,  however,  adaption  was  exact  and  complete 
after  100  adaptions  on  the  original  functions  (with  orthogonal  patterns). 
For  a  static  situation  or  for  very  gradually  changing  dynamic  processes, 
this  procedure  would  be  desirable. 
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FIG.  12.  ADAPTION  WITH  ALTERNATE  PR< 


VI.  FILE  SIMULATION 


To  obtain  a  better  idea  of  how  effective  the  proposed  application 
of  Adaline  to  a  file  would  be,  a  complete  simulation  of  a  small  file 
was  undertaken,  including  the  rearrangement  of  records  in  the  file  and 
an  evaluation  of  the  resultant  improvement  in  average  seek  time. 

Six  different  input  probability  functions  were  constructed.  These 
approximated  one-sided  normal  distributions  with  35  to  85  percent  of  the 
total  activity  concentrated  in  20  percent  of  the  records.  The  resulting 
functions  are  plotted  along  the  bottom  of  Fig.  13.  These  are  discrete 
functions  for  ten  records,  which  was  the  total  for  this  file.  It  was 
next  necessary  to  have  a  realistic  function  representing  variation  of 
seek  time  with  record  location.  There  are  ten  record  locations  numbered 
1  to  10.  Seek  time  (in  milliseconds)  as  a  function  of  record  number  is 
shown  in  Fig.  14,  assuming  a  home  position  one  unit  of  distance  removed 
from  the  first  record  position  and  all  records  equidistant.  This 
assumption  corresponds  to  every  record  in  a  separate  track  and  seek  time 
proportional  to  the  square  root  of  distance,  which  is  realistic  for  a 
bang-bang  type  of  actuator  having  equal  acceleration  and  deceleration. 

The  actual  magnitudes  of  the  seek  times  serve  only  to  establish  a  refer¬ 
ence  for  comparison. 

With  these  two  assumptions,  the  best-possible  and  the  worst-possible 
average  seek  times  were  determined.  The  first  would  occur  when  records 
1  through  10  happened  to  be  located  in  locations  1  through  10  respectively. 
The  worst  situation  would  require  the  reverse  order.  These  seek  times 
were  plotted  in  Fig,  13  vs  input  probability  functions. 

Six  sets  of  ten  random  patterns  were  next  assembled.  The  file 
simulation  for  this  case  is  performed  as  follows: 

1.  Pick  the  first  set  of  ten  patterns.  Assign  these  to  records  1 
through  10.  Use  the  first  input  probability  function. 

2.  Make  200  adaptions  and  interrogate  after  every  100  adaptions  to 
establish  two  output  probability  functions. 

3.  Sort  the  ten  records  in  order  of  decreasing  probability  as  given 
by  the  output  probability  function. 
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PIG.  13.  GRAPHICAL  REPRESENTATION  OP  PILE-SIMULATION  DATA. 
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FIG.  14.  SEEK  TIME  FOR  THE  RANDOM-ACCESS  FILE. 


4.  Compute  the  average  seek  time  with  this  new  arrangement  of  records. 

5.  Step  the  pattern  assignment  and  repeat  items  1  through  4  a  total 
of  ten  times. 

6.  Pick  the  next  set  of  ten  patterns  and  repeat  steps  1  through  5  a 
total  of  six  times. 

7.  Average  the  average  seek  times  to  get  a  probable  improvement  in 
seek  time. 

8.  Repeat  steps  1  through  7  for  all  six  input  probability  functions. 

The  results  of  this  simulation  are  shown  in  Fig.  13.  Plotted  vs 
input  function  are:  the  worst  average  seek  times  encountered  after  sort¬ 
ing  the  records  as  indicated  by  the  Adaline  output  after  both  the  first 
and  second  100  adaptions.  This  plot  shows  the  worst  operation  using 
Adaline  and  compares  favorably  with  the  worst  operation  not  using  Adaline, 
which  is  termed  "worst  possible  average  seek  time."  It  also  compares 
favorably  with  the  average  or  expected  operation  without  Adaline.  The 
best  operation  with  Adaline  was  plotted  which,  for  all  practical  purposes, 
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coincides  with  the  best  possible  operation  in  all  cases.  The  average  or 
expected  operation  with  Adaline  is  also  shown  and  is  almost  as  good  as 
the  best  possible  operation  and  substantially  superior  to  the  expected 
operation  without  Adaline.  Improvements  in  expected  average  seek  time 
with  Adaline  over  operation  without  Adaline  are  as  high  as  42  percent. 

Of  course,  where  the  input  function  is  fairly  flat,  improvements  are 
small  because  the  possible  improvements  to  be  made  are  limited.  The 
important  conclusion  to  be  derived  from  this  simulation  of  the  file  as 
a  whole  is  that  the  range  of  average  seek  times  that  can  be  obtained 
with  the  use  of  Adaline  is  close  to  the  best  operation  possible.  Further 
more,  the  average  of  this  range  is  even  closer  to  the  best  possible  opera 
tion  than  the  midpoint  of  the  range. 

Some  clues  will  be  pointed  out  in  Chapter  VII  which  may  explain  why 
the  operation  is  statistically  this  good,  even  with  random  patterns. 
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VII.  CROSS  EFFECTS  IK  ADAPTION  WITH  RANDOM  PATTERNS 


How  can  the  effect  of  adaption  toward  one  pattern  on  the  confidence 
level  of  another  pattern  be  measured? 

Consider  the  patterns  and  gains  as  vectors  in  an  N-dimensional 
space.  The  pattern  vectors  thus  end  at  the  corners  of  an  N-dimensional 
cube  and  their  lengths  are  equal  to  the  square  root  of  N. 

As  mentioned  in  Chapter  I,  the  confidence  level  is  formed  as  the 
sum  of  the  products  of  input  pattern  elements  and  the  corresponding 
gains.  The  confidence  level,  in  vector  terms,  is  then  the  scalar  prod¬ 
uct  of  the  gain  vector  and  the  pattern  vector.  In  the  adaption  procedure 
the  correction  added  to  the  gains  is  proportional  to  the  error  (a  scalar) 
with  the  sign  of  the  corresponding  pattern  element.  Considered  in  the 
N-dimensional  space,  the  correction  is  a  vector  parallel  to  the  pattern 
vector  on  which  adaption  is  being  made.  The  change  in  confidence  level 
of  another  input  pattern  is,  therefore,  the  scalar  product  of  the  cor¬ 
rection  vector  and  that  input  pattern  vector;  or,  the  change  of  the  con¬ 
fidence  level  of  another  input  pattern  is  proportional  to  the  scalar 
product  of  the  two  pattern  vectors.  Since  the  length  of  the  pattern 
vectors  is  \/n  ,  a  good  measure  of  this  cross  effect  would  be  the  scalar 
product  divided  by  N  (which  is  the  cosine  of  the  angle  between  the 
two  pattern  vectors).  This  can  be  called  the  "cross-effect  factor." 

An  estimate  of  an  average  value  of  this  factor  for  any  dimension 
can  be  obtained  by  first  looking  qualitatively  at  the  two-  and  three- 
dimensional  space.  In  the  two-dimensional  case,  there  are  only  three 
pattern  vectors  in  addition  to  the  one  under  adaption.  One  pattern 
vector  is  the  equal  and  opposite  of  the  latter,  which  will  be  the  case 
in  any  dimension;  the  other  two  are  orthogonal  to  it.  In  other  words, 
two  of  the  three  additional  pattern  vectors  are  orthogonal  to  the  pat¬ 
tern  vector  being  adapted  on.  Now,  in  three-dimensional  space,  all  the 
pattern  vectors  end  in  the  corners  of  a  cube.  Consider  the  cube  tilted 
so  that  the  diagonal  that  contains  the  adapted-on  vector  becomes 
vertical.  It  then  appears  that  all  the  pattern  vectors  not  on  that 
diagonal  are  "not  too  far"  from  a  horizontal  plane  through  the  center 
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of  the  cube.  This  observation  is,  perhaps,  an  indication  that  the  con¬ 
figuration  will  turn  out  similarly  in  higher  dimensional  cases  and  the 
average  scalar  product  will  be  much  less  than  N. 

Now  look  at  the  probable  magnitude  of  this  scalar  product  in  N- 
dimensional  space.  There  are  (N  +  l)  possible  values  of  this  scalar 
product,  including  the  product  with  itself,  which  is  included  for  sym¬ 
metry  and  because  the  final  form  of  the  average  magnitude  assumes  a 
neater  form.  The  actual  value  of  the  average  magnitude  is  barely 
affected  by  this  inclusion  for  higher  dimensions.  The  (N  +  l)  values 
represent  the  case  where:  (l)  all  the  elements  are  the  same,  (2)  one 
element  is  different,  (3)  two  are  different,  and  so  on  down  to  all 
elements  being  different.  Let  i  denote  the  number  of  elements  that 
are  different;  then  1  ranges  from  0  to  N.  Let 

p  3  probability  that  any  two  elements  being  multiplied  in  the  scalar 
product  are  the  same  =0.5 
q  =  probability  that  they  are  different  =0.5 
Let  the  pattern  vectors  be 

a(  a^ ,  Sg ,  a  g ,  a^ ,  a^ ,  . . . ,  Bjj  ) 

and 


Y(yl>  y2’  y3’  y4’  y5 . yjj) 

Then  the  scalar  product 

A  .  Y  =  aiyi  +  a2y2  +  a3y3  ♦  ...  ♦  V» 

And  for  any  i  the  scalar  products  and  their  probabilities  are  tabulated 
as  follows: 
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i 

A  •  Y 

Probability 

0 

N 

N  -N 

p  =  2 

1 

N  -  2 

„  N-l  „  -N 

N  •  p  •  q  =  N  •  2 

2 

N  -  4 

N  •  (N  -  l)/2  «  2_N 

M  -N 

3 

N  -  6 

W  -a 

/n\  -n 

i 

S  -  21 

0)  -2 

N/2 

(if  N  =  even) 

• 

0 

• 

• 

• 

/  N  \  -N 

M 

• 

/n\  -n 

N 

-N 

w  -2 

Or,  dividing  the  magnitude  of  the  scalar  product  by  N  gives  the 
probability  of  (N  -  2i)/N  occurring  as  being  (  ^  \  •  2  N. 


This  expression  is  plotted  for  N  =  2  and  N  =  5  in  Fig.  15,  and  for 
N  s  32  in  Fig.  16.  The  fact  that  the  mean  is  equal  to  0  assures  that, 
if  Adeline  adapts  on  a  large  number  of  patterns,  the  effect  on  some  other 
pattern  is  going  to  be  small.  If  Adallne  adapts  many  times  on  only  a 
few  or  on  only  one  pattern,  what  would  the  effect  be  on  another  pattern? 

If  Adeline  adapts  to  a  desired  output  of  +1  or  -1  and  makes  many  adaptions 
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PROBABILITY 


N 


PROBABILITY 


PIG.  15.  PROBABILITY  FUNCTION  FOR  CROSS-EFFECT 
COEFFICIENT  FOR  N  =  2  AND  N  =  5. 
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on  the  sane  input  pattern  with  a  time-constant  fact  C  >  1,  the  correc¬ 
tion  vector  will  decrease  in  magnitude  and  the  cross  effect  will  diminish 
accordingly.  It  is  still  desired  to  know  a  measure  of  the  likelihood  of 
the  cross-effect  factor  approaching  1 .  The  mean  of  the  absolute  value  of 
the  cross-effect  factor  or  the  median  of  the  absolute  value  will  shed  some 
light  on  that  question.  First,  consider  the  mean  of  the  absolute  value  or 
mean  magnitude  (MM)  or  first  moment  of  the  absolute  value  of  the  probabil¬ 
ity  function.  The  mean  magnitude  is  indicated  in  Figs.  15  and  16. 


MM  =  sum  of  ^probabilities 


X 


-  ?  •  k"  E  (")  •  '*  - 2i1] 

L  i=0  J 


If  N  =  even, 


MM 


1  o-N 
—  •  2  •  2 
N 


E  (")  •  <H  ‘  21) 


i=0 


-N 


(N/2)-l  (N/2)-l 

E  E  (") 


i=0 


i=0 


where 


for  ■  »  (T) 
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has  N  terms  if  N  =  even  and 

(N/2)-l 

E/N-l\  1  N-l  N-2 

-2 

i=0 

since  it  contains  N/2  terms  of  the  above  expression  and 
(N/2)-l  ,  „  N 

i=0  i=0  ' 

because  the  left-hand  side  equals  twice  the  first  N/2  terms  of 
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which  by  Stirling's  formula: 


2  'V*'.  Mjxtf' 


2_ 

Nit 


For  N  =  32, 


MMj,  =  0.141  Quite  small! 


If  N  =  odd, 


«“  "  ““O  "  N 


- 1(0-  |k- 
1*0 


2i 


I  .  2-N 

N 


(»-*)/*  /  \  JL  /  \ 

E  C  • ("  - 20  -  2  (?)(- 

W  i=(N+l)/2 


i=0 


Let  I  =  N  -  j 


2N 

*“o  =  ~ 


(N-l)/2  (N-l)/2 

E  (0  (1,-21)*  E  (»-j)  (H  • 2J) 

'  j=o  '  ' 


i=0 


where 


M  =  (N 

i»-j/  \j> 


2  • 


(»-l)/2  ,  v 

E  0  •  <"  ■ 20 

i=0 


2i) 


39 


SEL-63-135 


which  is  equal  to  the  next  lower  “V  (This  result  is  exact,  before 
applying  Stirling's  formula.)  In  other  words, 

MMQ  (N)  =  MMj,  (N  -  l) 

This  mean  magnitude  was  plotted  vs  N  in  Fig.  17  for  both  even  and  odd 

N's.  The  median  of  the  magnitude  was  also  computed  and  plotted  in  the 

same  figure.  Generally  the  median  is  even  smaller  than  the  mean,  which 

is  true  for  N  =  32  as  shown  in  Fig.  16.  In  this  case  we  have  a  prob¬ 

ability  of  0.5  that  the  effect  of  adaption  on  one  pattern  is  going  to 
affect  another  confidence  level  by  less  than  12.5  percent  of  the  correction 
made. 

It  is  realized  that  the  above  discussion  has  omitted  the  effect  of 
the  "bootstrap"  mode  of  picking  the  desired  output.  It  is  not  immediately 
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obvious  whether  or  not  that  mode  would  reduce  the  cross-effect  mean  even 
further. 


FIG.  17.  MEAN  MAGNITUDE  OF  CROSS-EFFECT  COEFFICIENT. 
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VIII.  CONCLUSION 


The  small  size  of  the  mean  and  median  magnitudes  of  the  cross-effect 
factor  explains  to  some  extent  the  successful  operation  with  the  use  of 
Adaline  in  the  file-simulation  experiment,  even  with  random  patterns. 

It  should  therefore  be  possible,  with  some  simple  algorithm,  to  construct 
the  patterns  assigned  to  a  record  from  the  identification  portion  of  the 
record  or  from  the  record  information  directly.  For  best  operation  this 
algorithm  should  result  in  a  unique  pattern  being  assigned  to  each  record, 
but  this  is  not  absolutely  necessary. 

The  above  results  may  be  applied  to  a  more  general  problem,  where  it 
is  desired  to  get  a  comparative  measure  of  the  frequency  of  occurrence  of 
a  number  of  events  as  in  Fig.  1.  The  file  simulation  has  demonstrated 
the  feasibility  of  using  Adaline  by  assigning  random  patterns  to  each 
event  that  is  to  be  counted,  and  proceeding  as  indicated  in  Fig.  1. 
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Oregon  Stitt  U 
Corvallis,  Ore. 

1  Attnt  H.J.  Oor thuya,  EX  Dept. 

Polytaehnie  Xnatltuta 
333  Jay  St. 

Brooklyn,  N.Y. 

1  Attnt  L.  Shaw,  EE  Dept. 

Polytaehnlo  Inatituta  of  Brooklyn 
Oraduato  Cantor,  Rout#  110 
Paralngdale,  N.Y. 

I  Attnt  Librarian 

Purdua  U 
Lafayatta,  Ind. 

1  Attnt  Library,  XX  Dapt. 

Ranaaalaar  Polytaehnie  Inatituta 
Troy,  N.Y. 

1  Attnt  Library,  8arlala  Dapt. 

*U  of  Saskatchewan 
College  of  Engineering 
Saakatoon,  Canada 
1  Attn:  Prof.  R.E.  Ludvig 

Syraeuaa  U 
Syracuse  10,  N.Y. 

1  Attn:  EE  Dapt. 

•Uppsala  U 

Inatituta  of  Phyalca 
Uppsala,  Swadan 
1  Attn:  Dr.  P.A.  Tova 

U  of  Utah 

8alt  Lake  City,  Utah 
1  Attnt  R.W.  Grow,  EX  Dapt. 

U  of  Virginia 
Charlottaavllla,  Va. 

1  Attn:  J.C.  Wyllie, Aldermen  Library 

U  of  Washington 
Saattla  5,  Wash. 

1  Attnt  A.X.  Harriaon,  EX  Dapt. 

Worchester  Polytaehnie  Inst. 

Worehastar,  Mass. 

1  Attn:  Dr.  H.M.  Naval! 

Yale  U 

New  Haven,  Conn. 

1  Attnt  Sioane  Phyalca  Lab. 

1  EX  Dapt. 

1  Dunham  Lab. ,Xngr.  Library 

INDUSTRIES 

Avco  Corp. 

Ran.  Lab. 

23R3  Revere  Beach  Parkway 
Everett  46,  Has a. 

1  Attnt  Dr.  Ourdos  Abell 

Argoeae  National  Lab. 

•TOO  South  Casa 
Argonae,  Ill. 

1  Attnt  Dr.  O.C.  Sisson 

Adniral  Corp. 

3M0  Cortland  St. 

Chicago  47,  Ill. 

1  Attnt  E.N.  Sobers ton,  Librarian 


Anperex  Corp. 

230  Duffy  Ava. 

Hlcksvllle,  Long  Island,  N.Y. 

1  Attnt  ProJ. Engineer,  S.  Barbas so 

Autonatlca 

Dlv .  of  North  Aaerlcan  Aviation,  Ine. 
9130  E.  leper la  1  Highway 
Denney,  Calif. 

1  Attnt  Tech.  Library  3040-3 

Ball  Telephone  Labs. 

Murray  Hill  Lab. 

Murray  Hill,  N.J. 

1  Attnt  Dr.  J.R.  Pierce 
1  Dr.  8.  Darlington 

1  Mr.  A.J.  Qroaanan 

Ball  Telephone  Labs.,  Inc. 

Technical  Information  Library 
Whlppany,  N.J. 

1  Attn:  Tech.  Repta.  Llbrn. , 

Whlppany  Lab. 

"Central  Electronics  Engineering 
Research  Inatituta 
Pllanl,  Rajasthan,  India 
1  Attn:  Ob  P.  Gandhi  -  Via:  ONR /London 

Coluabla  Radiation  Lab. 

338  Weat  120th  8t . 

1  New  York,  New  York 

Convalr  -  San  Diego 

Dlv.  of  General  Dynapica  Corp. 

San  Diego  12,  Calif. 

1  Attn:  Engineering  Library 

Cook  Research  Laba. 

6401  W.  Oak ton  St. 

1  Attn:  Morton  Grove,  Ill. 

Cornell  Aeronautical  Labs.,  Inc. 

4435  Oeneaape 
Buffalo  21,  N.Y. 

1  Attn:  Library 

El tel -McCullough,  Inc. 

301  Industrial  Way 
San  Carlos,  Calif. 

1  Attn:  Research  Librarian 

Ewan  Enight  Corp. 

East  Natick,  Masa. 

1  Attn:  Library 

Fairchild  Semiconductor  Corp. 

4001  Junlpero  Serra  Blvd. 

Palo  Alto,  Calif. 

1  Attn:  Dr.  V.N.  Orinleh 

Owners 1  Electric  Co. 

Defense  Electronics  Div. ,  USED 
Cornell  Univeralty,  Ithaca,  N.Y 
1  Attn:  Library  -  Via:  Commander, 

ASD  W-P  AFB,  Ohio,  AMNOW 
D.X.  Lewis 

General  Electric  1WT  Products  Sec. 

•01  California  Ave. 

Palo  Alto,  Calif. 

1  Attn:  Tech.  Library,  C.Q.  Lob 

General  Electric  Co.  Res.  Lab 
P.0.  Box  10M 
Schnectady,  N.Y. 

1  Attn:  Dr.  P.M.  Lewis 
1  R.L.  Shuey,  Mgr.  Info. 

Studies  Sec. 

General  Electric  Co, 

Electronics  Park 
Bldg.  3,  Bn.  143-1 
Syracuse,  N.Y. 

Doc.  Library,  Y.  Burke 


Gllflllao  Brothers 
1815  Venloe  Blvd. 

Los  Angeles,  Calif. 

1  Attnt  Engr.  Library 

The  Hallierafters  Co. 

5th  and  Kostner  Ave. 

1  Attnt  Chicago  24,  Ill. 

Hewlett-Paokard  Co. 

1501  Page  Mill  Road 
1  Attn:  Palo  Alto,  Calif. 

Hughes  Aireraft 
Malibu  Beach,  Calif. 

1  Attn:  Mr.  lams 

Hughea  Aircraft  Ct. 

Florence  at  Teals  St. 

Culver  City,  Calif. 

1  Attnt  Tech. Doe. Can. ,  Bldg  4, 

Rm.  Cl 04 A 

Hughea  Aircraft  Co. 

P.0.  Box  27B 
Newport  Beach,  Calif. 

1  Attn:  Library,  Seniconductor  Div. 

IBM,  Box  390,  Boardman  Road 
Poughkeepsie,  N.Y. 

1  Attn:  J.C.  Logue,  Data  Systama  Div. 

IBM,  Poughkeepsie,  N.Y. 

1  Attnt  Product  Dev. Lab. ,X.M.  Davis 

IBM  ASD  and  Reaearch  Library 
Monterey  and  Cottle  Roada 
San  Jose,  Calif. 

1  Attnt  Miss  M.  Griffin,  Bldg. 025 

ITT  Federal  Imbs. 

300  Washington  Ave. 

Nutley  10,  N.J. 

1  Attn:  Mr.  E.  Mount,  Librarian 

Laboratory  for  Electronics,  Inc. 

1075  CoMonvealth  Ave. 

Boston  IS,  Mass. 

1  Attn:  Library 

LXL,  Inc. 

75  Akron  St. 

Coplague,  Long  Island,  N.Y. 

1  Attn:  Mr.  R.8.  Mautner 

Lenkurt  Electric  Co. 

San  Carlos,  Calif. 

1  Attn:  M.L.  Waller,  Librarian 

Libraaoope 

Div.  of  Oe moral  Precision,  Inc. 

•OB  Western  Ave. 

Glendale  1,  Calif. 

1  Attn:  Engr.  Library 

Lockheed  Missiles  and  Space  Dlv. 

P.O.  Bom  504,  Bldg.  5S4 
Sunnyvale,  Calif. 

1  Attn:  Dr.  W.M.  Harris,  Dept. 67-30 
O.W.  Price,  Dapt.  67-33 

Helper,  Inc. 

3000  Arlington  Blvd. 

Falls  Church,  Va. 

1  Attn:  Librarian 

Microwave  Associates,  Inc. 

Northwest  Industrial  Park 
Bur 1 lag t cm,  Hass. 

1  Attn:  K.  Bert  tenon 
1  Librarian 
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Airborne  Instruments  Lab. 

Comae  Road 

Deer  Park,  Long  Island,  N.Y, 

1  Attn:  J.  Dyer,  Vice-Pres.ATech. Dir. 1  Attn: 
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Mlcrowsv#  Electronic*  Corp.  lUy th#on  Manufacturing  Co. 

4061  Transport  8t.  Microwave  and  Power  Tub*  Dlv. 

Palo  Alto,  Calif.  Burlington,  Haas.  1 

1  Attn!  8.F.  Kaiaal  1  Attn}  Librarian,  8p*no*r  Lab. 

M.C.  Long 


Mlnnsapolis-Honaywall  Regulator  Co. 
1177  Blu*  Heron  Blvd. 

Riviera  Beach,  Fla. 

1  Attn!  Seaiconductor  Product*  Library 

Monsanto  Research  Corp. 

Station  B,  Box  8 
Dayton  7,  Ohio 
1  Attn!  Mra.  D.  Crabtree 

Monsanto  Chemical  Co. 

800  N.  Llnbergh  Blvd. 

St.  Loula  66,  Mo. 

1  Attn:  Mr.  I.  Orban,  Mgr.  Inorganic 
Dev. 

•Dir. ,  National  Physical  Lab. 

Hilslde  Road 
New  Delhi  13,  India 
1  Attn:  S.C.  8 harm*  -  Via: 

ONR /London 

•Northern  Electric  Co. ,  Imtd. 

Research  and  Development  Labs. 

P.O.  Box  3911,  Station  "C” 

Ottawa,  Ontario,  Canada 
1  Attn:  J.F.  Tat  lock 

Via:  ASD,  Foreign  Release 
Office 

W-P  APB,  Ohio 

Hr.  J.  T royal  (ASYP) 

Northronics 

Palo  Verdea  Research  Park 

6101  Creat  Road 

Palos  Verdes  Estates,  Calif. 

1  Attn:  Tech.  Info.  Center 

Pacific  Seaiconductor*,  Inc. 

14920  So.  Aviation  Blvd. 

Lawndale,  Calif. 

1  Attn:  HQ.  North 

Phllco  Corp. 

Tech.  Rep.  Division 
P.O.  Box  4730 
Philadelphia  34,  Pa. 

1  Attn:  F.R.  Sherman,  Mgr.  Editor 

Philco  Corp. 

Jolly  and  Union  Meeting  Roads 
Blu*  Bell,  Pa. 

1  Attn:  C.T.  McCoy 
1  Dr.  J.R.  Peldaoier 

Pol a rad  Electronics  Corp. 

43-10  Thirty-Fourth  ft. 

Long  Island  City  1,  N.Y. 

1  Attn:  A.N.  fooaeascbeia 

Radio  Corp.  of  America 

RCA  Labs. ,  David  Saraoff  Rea.  Cen. 

Princeton,  N. J. 

S  Attn:  Dr.  J.  fklaasky 

RCA  Labe. ,  Princeton,  N.J. 

1  Attn:  R.  Johnson 

RCA,  Missile  Bloc,  sad  Controls  Dept. 
Woburn,  Mass. 

1  Attn:  Library 

The  Rand  Corp. 

1700  Mala  ft. 

Santa  Monica,  Calif. 

1  Attn:  Melon  J.  Waldron,  Librarian 


Raytheon  Manufacturing  Co. 

Rea.  Dlv.,  38  Seyon  St. 

Waltham,  Mass.  1 

1  Attn:  Dr.  H.  Stats 
1  Mra.  M.  Bennett,  Librarian 

1  Research  Dlv.  Library 

Roger  White  Electron  Devices,  Inc. 

Tall  Oeka  Road  1 

1  Laurel  Hedges,  Stamford,  Conn. 

Sand la  Corp. 

Sandla  Base,  Albuquerque,  N.M. 

1  Attn:  Mra.  B.R.  Allen,  Librarian  ] 

Sperry  Rand  Corp. 

Sperry  Electron  Tube  Dlv. 

1  Gainesville,  Fla. 

] 

Sperry  Gyroscope  Co. 

Dlv.  of  Sperry  Rand  Corp. 

Great  Neck,  N.Y. 

1  Attn:  L,  Sw.rn  (HS3T105) 

Sperry  Gyroscope  Co. 

Engineering  Library 

Mall  Station  F-7 

Great  Neck,  Long  Island,  N.Y. 

1  Attn:  K.  Barney,  Engr.  Dept.  Head 

Sperry  Microwave  Electronics 
Clearwater,  Fla. 

1  Attn:  J.E.  Pippin,  Res.  Sec.  Head 

Sylvanla  Electric  Products,  Inc. 

500  Evelyn  Ave. 

1  Mt.  View,  Calif. 

Sylvanla  Electronics  Syatems 
100  First  Ave. 

Waltham  54,  Mass. 

1  Attn:  Librarian,  Waltham  Labs. 

1  Mr.  E.E.  Hollis 

Technical  Research  Group 
1  Syoaett,  L.I.,  N.Y. 

Texas  Instnusents,  Inc. 
Semiconductor-Components  Div. 

P.O.  Box  205 
Dallas  22,  Tex. 

1  Attn:  Library 

2  Dr.  W.  Adcock 

Texas  Instruments,  Inc. 

P.O.  Box  8015 
Dallas  23,  Tex. 

1  Attn:  M.E.  Chun,  Apparatus  Dlv. 

Texas  Instruments 
8017  R.  Celle  Tuber i a 
Phoenix,  Arisons 
1  Attn:  R.L.  Pritchard 

Texas  Instrumsats,  Iso. 

Corporate  Research  sad  Engineering 
Technical  Reports  Service 
P.O.  Box  3474 
1  Atta:  Dallas  S3,  Tax 

Tektronix,  Inc. 

P.O.  Box  500 
Beaverton,  Ore. 

4  Atta:  Dr.  J.F.  Da  Lord,  Dir.  of  Reaoarck 

Varies  Assoc la tea 
811  Raasea  Way 
Palo  Alto,  Calif. 

1  Atta:  Tech.  Library 


Wslteraenn  Electronics 
4348  North  38th  St. 

Mllwaukoo  8,  Wlaconain 

Wostinf house  Electric  Corp. 
Friendship  International  Airport 
Box  748,  Baltimore  3,  Md. 

Attn:  O.R.  Kilgore,  Mgr.  Appl. 

Rea.  Dept.  Baltimore  Lab. 

Wes ting house  Electric  Corp. 

3  Gateway  Center 
Pittsburgh  22,  Ps. 

Attn:  Dr.  G.C.  Sxlklai 

Wsstlnghous*  Else trie  Corp. 

P.O.  Box  284 
Elmirs,  N.Y. 

Attn:  S.S.  King 

Zenith  Mdlo  Corp. 

6001  Dickens  Ave. 

Chicago  39,  Ill. 

Attn:  J.  Markin 


4 


•Ho  AF  or  Classified  Reports. 


